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1 .  Simaary 

This  paper  considers  some  aspects  of  a.  discrete  attack-defense 
game  in  which  there  are  targets  for  both  the  attacker  and  the 
defender.  In  section  two  the  basic  game  is  described.  Following 
this  there  is  a  discussion  of  the  relation  of  past  results  to 
this  game. 

In  section  three  the  discrete  game  is  examined  in  detail. 
Expressions  are  obtained  for  the  probability  of  victory  by  either 
player  at  any  step  in  the  game,  time  to  termination  of  the  game, 
and  the  mathematical  expectation  and  variance  of  time  to  termination 
for  both  fixed  and  mobile  target  for  the  attacker.  For  the  case 
of  fixed  target  the  space  of  strategies  for  each  player  is  dis¬ 
cussed  along  with  several  possible  payoff  kernels.  Some  conditions 
are  given  which  are  sufficient  to  obtain  a  saddle  point  and  minimax 
solution  to  the  game. 

In  section  four  some  examples  of  strategies  are  explored. 

In  section  five  extensions  of  the  discrete  game  to  the  continuous 
game  are  considered. 


?.  Description  of  the  Game  and  Past  Research 

There  are  two  versions  of  the  attack-defense  game  with 
targets.  Both  games  will  oe  defined  here  but  only  the  first 
version  will  be  considered  in  Section  5- 

The  first  version  will  be  called  the  discrete  game.  It 
can  be  described  as  follows.  One  is  given  a  finite  or  infinite 
grid  of  lattice  points  in  E?  or  E^  labeled  0,1, ?,..., N.  The 
two  players  are  A,  the  attacker,  and  D,  the  defender.  The  target 
which  the  attacker  wishes  to  hit  is  X,  which  may  be  assumed  to 
be  either  stationary  or  mobile.  Also,  the  initial  positions  of 
A,  D,  and  X  are  given.  The  initial  position  of  D  need  not 
coincide  with  the  initial  position  of  X. 

The  players,  A  and  D,  as  well  as  X,  are  required  to  occupy 
lattice  points.  Multiple  occupancy  of  a  lattice  point  is  allowed. 
The  players  move  simultaneously  at  discrete  times.  The  goal  of 
A  is  to  occupy  the  same  lattice  point  as  X  does  on  the  same  move 
before  the  positions  of  A  and  D  coincide.  If  this  occurs,  A 
wins  and  the  game  ends.  The  goal  of  D  is  to  occupy  the  same 
lattice  point  as  A  does  before  the  positions  of  A  and  X  coincide. 
If  this  occurs,  D  wins  and  the  game  ends.  If  A,D,  and  X  occupy 
the  same  lattice  point  simultaneously,  then  A  wins,  since  D  may 
destroy  A,  but  X  will  be  destroyed  in  the  process. 

A  time  limit  on  the  game,  TL,  is  given.  The  game  must  end 
by  time  T^.  If  by  time  T^  neither  A  nor  D  has  won,  then  the  game 

is  declared  over  and  neither  player  wins.  The  limitation  T^  can 
be  thought  of  as  a  fuel  constraint  on  one  or  both  of  the  players. 
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An  example  of  the  initial  positions  occupied  at  the  beginning 

is  shown  in  the  following  diagram. 

♦  •*  # 

*  +  C 

*  # 

The  second  version  of  the  game  will  be  called  the  continuous, 
or  differential  game.  In  this  game  the  players  move  along  continuous, 
differential  paths  contained  in  some  connected  region  (finite  or 
infinite)  in  or  E^.  The  goals  of  the  players  remain,  in 
general,  the  same  except  that,  because  of  the  continuous  nature 
of  the  game,  "zones  of  destruction"  for  each  player  need  to  be 
introduced.  These  zones  are  specified  by  positive  numbers  **4^. 

is  such  that  if  the  Euclidian  distance  between  A  and  X  is  less 
than  ,  then  X  is  considered  to  be  destroyed  and  A  wins; and  if 
the  Euclidian  distance  between  A  and  D  is  less  than  j  then  A 
is  destroyed  and  D  wins.  As  in  the  discrete  game,  the  convention 
is  made  that  if  both  A  and  X  lie  within  ^  of  D,  then  A  wins  and 
the  game  is  over. 

The  continuous  version  can  be  seen  to  be  quite  analogous  to 
the  discrete  game  and  some  of  the  results  for  the  discrete  game 
can  be  carried  over  to  the  continuous  game. 


of  the  discrete  game  in  E d 

«  •  .  » ^  • 


*  *  • 


f  *  t  c 

X  D 
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As  noted  in  the  first  section  certain  simple  pursuit-evasion 
games  have  been  analyzed  in  the  existing  literature.  For  example, 
Karlin  [10],  Bellman  [1],  and  Dresher  [6]  have  considered  seme 
discrete  pursuit-evasion  games  using  the  method  of  payoff  kernels. 

It  is  clear  that  the  discrete  game  described  in  the  section 
contains,  as  special  cases,  games  in  which  the  strategies  are 
matrices.  Such  pursuit-evasion  games  have  been  studied  by  Cohen 
[ and  Dubins  [7].  Charnes  and  Schroeder  [5]  considered  some 
special  types  of  stochastic  games  relating  to  antisubmarine  warfare. 
It  should  be  noted  that  most  of  these  papers  do  net  use  the  concept 
of  a  target  for  the  attacker.-  The  few  that  do  consider  targets 
for  the  attacker  do  not  allow  movement,  but  instead  examine 
certain  allocation  problems  relating  to  offensive  and  defensive 
units. 

There  have  also  been  several  studies  of  the  classical  pursuit- 
evasion  game  in  the  continuous  version.  Some  of  these  studies 
are  Issacs  [93,  Ho,  ct  *1  [8],  Cockayne  [53,  Berkovitz  and 

Fleming  [P 3,  and  Pontryagin  [113.  These  papers,  in  addition  to 
not  having  a  target  for  the  attacker,  present  results  based  primarily 
on  solutions  of  certain  types  of  differential  equations  with  various 
constraints  and  side  conditions. 


5.  The  Discrete  Game 

5.0.  Notation  and  Easic  Definitions 

The  following  notation  will  be  used  extensively  in  this 
section. 

(5.0.1)  A  =  attacker. 

(5.O.?)  D  *  defender. 

(3.0.5)  A  *  target  for  A. 

(5.0.4)  =  time  limit  for  the  game. 

(5.0.^)  N  =  number  of  lattice  points  given. 

(5.0.6)  INA  *  position  of  A  after  the  first  move  and  before  the 
second  move. 

(5.0.7)  IND  =  position  of  D  after  the  first  move  and  before  the 
second  move. 

(5.0.8)  INX  =  position  of  X  after  the  first  move  and  before  the 
second  move.. 

(5.0.9)  T  *  termination  time  in  the  game(a  rtndcm  vtrixbic., 
(5.0.iu)  =  set  of  strategies  for  A. 

(5.0.11)  J^=  set  of  strategies  for  D- 

(5.0.1?)  J  «  set  of  strategies  for  X. 

(5.0.15)  The  phrase  ,,ST(A)=U1<  will  mean  "A  follows  strategy  U" 
(similarly  for  ST(D)  and  ST(X)). 

Moves  occur  in  the  game  at  discrete  times  1, ?,..., t,  t+lT...,T^. 
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Define  POSA,  PCSD,  and  POSX,  functions  of  time,  by 
(5.0.14)  POSA(t)  =  position  of  A  at  time  t, 

(5.0.15)  POSD(t)  =  position  of  D  at  .  time  t, 

and 

(5.0.16)  ?0SX(t)  =  position  of  X  at  '  time  t. 

5.1  Discrete  Game  with  Fixed  Target  for  Attacker. 

In  this  situation  X  cannot  move^  POSX(t)  =  INX  for  each 
t  >  1  and  is  a  singleton  strategy.  Hence,  it  is  not  necessary 
to  consider  . 

5.1.1  Definition.  Define  functions  TRANSA,  TRANSD,  PRAD1,  PJRAD2 
as  follows; 

Let  ,  Vvjj,  and  let  i,j,  and  k  be  lattice  points. 

For  e&c.  time  t  with  t  £  T^  define 

(5. 1.1.1)  PRADl(i,cj,t;U,V)  =  P[P0SA(t)=i,  P0SD(t)=j,  and 

T  >  t  I  ST(A)=U  and  ST(D)=V3, 
(5.1.1.F)  PRAD? (i,j,t;U,V)  =  P[P0SA(t)=i,  P0SD(t)=j,  and 

T  >  t  I  ST(A) =U  and  ST(D)=V3, 

and  for  j'/k  and  t«TL 

(5. 1.1. 5)  TRANSA ( i, t+ljj ,k,U)  =  P[PC  A(t+l)=i  I  P0SA(t)=j, 

P0SD(t)=k,  and  ST(A)=U3 

and 

(5. 1.1. 4)  TRANSDC i , t +1 ; j , k , V)  =  P[P0SD(t4l) =i  i  P0SA(t)=j, 

P0SD(t)=k,  and  ST(D)=V3. 
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It  shou]d  be  noted  that  when  the  two  players  select  strategies, 
these  strategies  will  determine  the  probabilities  defined  in  5.1.1. 
For  this  reasonj.for  any  event  C,  denote  P[C  I  ST(A)=U  and  ST(D)=V] 
by  P[C;U,V3. 

The  first  move  of  the  players  is  to  move  onto  INA  and  IND, 
respectively.  This  might  be  termed  a  LeMans  start  for  the  game. 
Prom  the  LeMans  start  the  following  lemma  is  immediately  obtained. 

5.1.?.  iSffifflft*  For  U  and  for  V  «• 

(  1  if  i=INA  and  j=IND 

(5. 1.2.1)  PRADl(i,o,l;U,V)=  ) 

v.  0  otherwise 

0  if  i=INA=IND=j 

\ 

(5. 1.2. 2)  P3AD2 (  i ,  j ,  1  j  U,  V)  =  \ 

1 

t  PRADl(i,j,l;  U,V)  otherwise 

(  0  if  INA=IND 

(5. 1.2. 5)  PCT  >  l'jU,V]  =  I 

‘v.  1  otherwise. 

An  inductive  method  can  now  be  used  to  determine  the  values 
of  the  functions,  PRAL1  and  PRAD2. 
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(5. 1.3.1)  PRADl(i,o,t+l;U,V)  =  Z  J  PRAD?(k,o,t;U,V)TRANa(i>t+l;k,m,U). 

Ik  m 

\  k*  *%•  VTRANSD  (  o ,  t +1  ,*  k ,  a ,  V) 


f  0 


(5.1. 3.2)  PRA.D2(i,o,t+ljU,V)  = 


if  i=j  or  if  i=lNX 


PRADl(it j, t+i;U,V)  otherwise. 


Proof :  (5.1. 5.2)  follows  from  (5.1. 5-1)  and  (5.1.1.?).  Consider 

(5.1. 5.1).  One  hasaby  definition  of  PRADlj  that 

(5. 1.5. 5)  PRAD1 ( i , 3 , t+1 ; U, V) =  P[?OSA(t+l)=i  and  POSD(t+l)=o  I 

T  >  t,  ST(A)=U,  ana  ST(D)«V]  * 

•P[T  >  t  l  S?(A)=U  and  ST(D)=V]. 

The  first  term  on  the  right  hand  side  of  (5. 1.5. 5)  can  be  decomposed 
as  follows 

(5. 1.5. 4)  P[POSA(t+l)=i  and  POSD(t+l)=o  I  T  >  t,  ST(A)=U,  and  S?D)=V3  = 

=  I  I  P[POSA(t+l)=i,  POSD(t+l)=j,  POSA(t)=k,  and 
v  .  ^ 

>♦«  , 

POSD(t)=a«  T  >  t,  ST(A)=U,  and  ST(D)=V] 

=  f.  .  P(POSA(t+l)=i  and  POSD(t+l)=j  I  POSA(t)=k, 

* 

POSD(t) =n,  T  >  t,  ST(A)=U,  and  ST(D)=V] 

P[?OSA(t) =k  and  FOSD(t)=a  I  T  >  t, 

ST(A)=U,  and  ST(D)=VJ 
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Substituting  (3. 1.5. 4)  into  (5.1. 5. 5)  yields 

(5*  1*3. *5)  PRADl(i,j,t+l,*U,V)=Z  I  P[P0SA(t+l)=i  and  P0SD(b+l)=j| 

(ktm 5i)  I  P0SA(t)=k, 

POSD(t) =m,  T  >  t,ST(A)”U,  and 
ST(D) =V] ♦ 

•P  £P0SA(t)=k  and  PC3D(t)=m| 

T  >  t,  ST(A)=U  and  ST(D)=V> 

•P  It  >  t  i  ST(A)=U  and  ST(D)=V] 

and  so, 

(5.1. 5.6)  PRADl(i, j,t+l;U,V) ~Z  l  P  [P0SA(t+l)=i  and  P0SD(t+i ) =j  | 

(i};xJP0SA(t)=k,  ?0SD(t)=m,  T  >  t, 
ST(A)=U,  ST(D) =V] . 

•P[P0SA(t) =k,  P0SD(t)=m,  and 
T  >  t)  ST(A)=U,and  ST(D)  =  V]. 

Note  now  that  the  second  probability  inside  the  summations  of 
(5.1. 5*6)  is  just  PRAD?(k,m,t;U,V).  The  first  probability  inside 
the  summations  in  (5. 1.5. 6)  can  be  split  into  P  [P0SA(t+l)=j.  I 
P0SA(t)=k,  POSD(t) =m,  ST(A)=U,  and  ST(D)=?)  .  P[P0SD(t+l)  =  j  I 
POSA ( t )  =k ,  POSDi^t )  =m,  ST(A)=U,  and  ST(D)=V]  because  the  events 
P0SA(t+l)=i  and  P0SD(t+l)=j  are  conditionally  independent  given 
the  state  of  the  game  and  position  of  the  players  in  the  t-th  move. 
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However,  this  product  of  probabilities  is  just 
TRANSA(i,t+l;k,m,U, V)  •  TRANSD(i, t+l;k,m,U,V) .  Substitution  of 
these  results  into  (5.1.5. 6)  gives  (5.1. 3.1) ■ and  so  completes  the 
proof. 

The  expressions  obtained  in  3.1.5  can  be  employed  to  calculate 
the  probabilities  that  A(or  D)  will  win  in  the  t-th  move,  when 
A  and  D  are  using  strategies  U  and  V,  respectively.  Since  the 
probabilities  will  be  obtained  inductively,  the  probabilities 
for  the  first  move  are  given  in  the  following  lemma,  the  proof 
of  which  is  immediate  from  the  LeMans  start  of  the  game. 

3.1.4  Lemma.  For  and 

(0  if  INA  /  INX 

(5. 1.4.1)  PtA  wins  at  step  ljU,V]=y 

U  if  INA  =  INX 

fO  if  IND/INA  or  if  INA=IND=INX 
(3.1.4.?)  P[D  wins  at  step  1;U,V]*\ 

V.1  otherwise. 


For  the  general  step  the  following  theorem  is  obtained. 
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5.1.^  Theorem,  For  U*j^,  V  and  t  >  1 

(5. 1.^.1)  PCA  wins  in  the  (t+l)-st  move  and  T  >  t  ;U,V]= 

I  £ TRA.NSA ( INX ,  t +1 ;  i ,  j ,  U)  PRAD?(i,  j,  t;U,  V) 

and  L*J 

c  tm 

(5.1.^.P)  PCD  wins  in  the  (t+l)-st  move  and  T  >  t  ;U,V]= 

«  2  PRADl(o,j,t+l;U,V). 

jtw 

Proof :  Consider  (?.  l.S.l).  Observing  that  A  wins  in  the  (t+l)-s-o 

move  if  and  only  if  POSA(t+l)=INX=POS(X) ,  one  has  by  decomposition 


P[A  wins  in  the  (t+l)-st  move  and  T  >  t  ;  U,V]  = 

=  Z  Z  P[POSA(t+l) =INX,  POSA(t) =i ,  POSD(t ) -j ,  and 

T  >  t  ;  U,V], 

Conditioning^  one  obtains 


PCA  wins  in  the  (t+l)-st  move  and  T  >  t  ;  U,V]  = 

=  Z  Z  PlPOSA(t+l)=INX  I  POSA(t) =i,  POSD(t)=j, 

i  .  J 

T  >  t,  ST(A) =U,  and  ST(D)=V]» 

t  tl*X 

•  P[POSA(t) =i ,  POSD(t) =j ,  and  T  >  t  I  ST(A)=U 


and  ST(D) - V], 


Since  the  first  probability  inside  the  summations  is.-TRANSA([NX, 
t+l;i,j,U)  and  the  second  is  PRADP(i, J,t;U,V),  (3.1.S.1)  is.  obtained. 

To  verify  notice  that  D  wins  in  the  (t+lj-st  move 

if  and  only  if  POSD(t+]J=POSA(t+l),  POSA(t+])/INX,  and  T  >  t.  Hence, 

P[D  wins,  in  the  (t+3)-st  move  and  T  >  t  j  U,V]  =  2  i*  - 

J*IV* 

and  T  >  t  ;  U,Vj.  Since  the  term  inside  the  summation  is 
?RAD.l(,i, o,t+l;U,V) ,  the  verification  of  (5.1.5.?)  is  complete. 
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Expressions  for  the  probability  of  termination  at  the  (t+l)-st 
move,  and  not  before,  can  now  be  derived. 

5.1.6.  Corollary.  Por  and  t  >1 

(5. 1.6.1)  P[T=t+l  ;  U,V]  =  Z  2  TRAWSA(INX,t+lji, j,U)* 

(^•PRAD?(i,j,tiU,V)  + 

+  I  PRA0e.(j.j,'t4l;U/v'>  . 
j*m* 

Proof :  It  is  clear  that 

P[T=t+l  ;U, V]  =  P[A  wins  at  the  (t+l)-st  move  and  T  >  t;  U,V]  + 

P[D  wins  in  the  (t+l)-st  move  and  T  >  t;  TJ,V]. 

(5. 1.6.1)  follows  then  from  (5. 1.5.1)  and  (5.1.6.?). 

The  distribution  of  the  random  variable  of  termination 

can  now  be  determined  whenever  t  <  Tt .  For  t  =  Tt  set 

If  L 

P[T=T  ;  U,V)  =1-  Z  P(T=t  ;  U,V] 

Alsoj  given  strategies  and  V«^  the  mathematical  expectation 

and  variance  of  termination  can  be  found. 

5.?.  Discrete  Game  with  Mobile  Target  for  Attacker. 

In  this  situation  X,  the  target,  is  mobile.  The  assumption 

is  made  that  A,D,  and  X  make  independent  movements  at  the  (t+l)-st 

move  given  their  positions  at  the  t-th  move.  The  probabilities 
that  will  be  considered  are  first  defined  and  then  expressions 
are  derived  inductively  as  in  the  previous  part  of  this  section 
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with  a  .fixed  target.  It  might  be  noted  that  this  version  of 
the  game  can  be  viewed  as  a  three  person  game  with  coalition 
and  with  one  of  the  players  in  the  coalition  acting  evasively  or 
passively.  The  terms  that  are  not  defined  in  this  section  will 
have  the  same  mining  as  they  had  in  3.1. 

3.2.1  Let  ,  and  t  be  a  time 

<  Tl.  Let  i,j,k,  and  m  be  lattice  points.  The  functions 
PRADX1,  PRADX2,  TRANSA,  TRANSD,  and  TRANSX  are  defined  as  follows. 

(5. 2. 1.1)  PRADXl(i,j,k,t;U,V,W)  =  P[POSA(t)=i,  POSD(t)=j,  POSX(t)=k, 

and  T  >  t  i  ST(A)=U,  ST(D)=V, 
and  ST(X) =W] . 

(5.2.1.?)  PRADX?(i,j,k,t;U,V,W)  =  P[POSA(t)=i,  POSD(t)=j,  POSX(t)=kJ 

and  T  >  t  !  ST(A)=U,  ST(D)=V, 
and  ST(X) =W] . 

(3. 2. 1.3)  TRANSA ( i ,  t +1 ; j , k , m ,  U) =P[POSA ( t+1 )  =i  |  POSA(t)=j,  POSD(t)=k 

POSX(t) =m,  and  ST(A)=U]. 

(3. 2. 1.4)  TRANSD(i, t+1; j ,k,m, Vy  =P[P0SD(t+l)=i  |  POSA(t)=j,  POSD(t)=* 

.T IL/zVJ. 

(5.2.1.5)  TRANSX(i, t+1; j,k,m,W)=P[POSX(t+l)=i  I  POSA(t)=j,  POSD(t)=k, 

POSX(t) =m,  and  ST(X)=W]. 
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The  following  lemma  is  an  immediate  consequence  of  these 


definitions. 


5.?.?  Lemma.  For  U#Jt, ,  V*^,  W «/x  and  for  i.j,  and  k  lattice 

points 

(1  if  i=INA,  j  =IND,  and  k=INX 

0.2. 2.1)  PHADX1 (i ,  o ,  k,  1 ;  U,  V,  W)  =  \ 

Lo  otherwise, 


0.2. 2. 2)  PRADX2(i1tj,k,l;U1V,W)  =  /) 


if  i=INA=IND= j  or 


v.  Pkal  >1  'ijC ,  si;  *,  t  h  ot  ••  **  'i 


(5 .2.2.5)  PCA  wins  in  1st  ir.ovejU,  V,  W]  = 


1  if  IHA=INX 


otherwise,, 


(5. 2. 2.4-)  PCD  wins  in  1st  move;U,V,W]  = 


1  if  IND=INA/INX 


0  otherwise. 


(5. 2. 2. 5)  PCT-1  i  U,V,W]  = 


/  1  if 


INA=IND  or  INA=INX 


0  otherwise. 
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An  inductive  process  can  now  be  used  to  calculate  the 
values  of  the  functions  PRADX1  and  PRADX?  using  the  result  of 
the  following  theorem. 

5.2.5.  Theorem.  Let  W  and  suppose  i,J,  and  k 

are  lattice  points  and  that  1  <  t  <  T^. 

(5*?. 5.1)  PRADX1  (i,j,k,t+l;U,V,W)  =IIZ  PRADX2(m,n,q,t;U,V,W)' 

•*«  i 

•» 

•TRANSA(i , t+l;m,n,q,U)*  TRANSU( j , t+1 ;m,n, a, V) * 
•TRANSX(k,t+l;m,n,q,W) 

^0  if  i=j  or  i=k 

(5-2.5.?)  PRADX?  (i,-d,k,t->ljU,V,W)  =  > 

tpRADXl(i, j,k,t+l;U,V,W)  otherwi 

Proof :  This  proof  parallels  the  proof  of  theorem  5-1.5  and  so 
is  omitted. 

5.?. 4.  Theorem.  For  U and  yJ  *4* 

(5.?. 4.1)  p[A  wins  in  the  (t+]^-st  move  and  T  >  t  ;U,V,W]  = 

*  Z  I  2  2.  TRANSA(i,t+l; j,k,m,U)-TRANSX(i,t+l;o,k,m,W). 

C  4 

*PRADX?(j  ,k,m,  t;U,  V,  '*/), 
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Proof:  The  proof  of  (5.?. 4.1)  is  analogous  to  that  of  (5. 1.^.1) 
and  is  omitted.  The  probability  on  the  left  hand  side  in  (5.7.4.?) 
can  be  decomposed  over  all  possible  locations  A  and  D  can  meet 
and  then  decomposed  over  all  possible  prior  positions  of  A,D,  and 
X  so  that  one  has 

P[D  wins  in  the  (t+l)-st  move  and  T  >  t;U,V,W]  = 

=  P[POSA(t+l)=i,  POSD(t+l)  =i,  POSX(t+l)/i,  and  T  >  t;  U,V,V/] 

=  Z  Z  Z  Z  P[POSA(t+l)=i,  POSD(t+])=i,  POSX(t+l)/i  I  POSA(t)=j, 

L  k  ** 

'j**  ?OSD(t)  =k,  POSX(t)=m,  T  >  t,  ST(A)=U,  ST(D)=V,  and 

ST(X) =W]  •  P[POSA(t)=j ,  POSC(t) =k,  POSX(t)=m,  and 
T>t  j  U,V,Uf3. 

Using  the  fact  that  the  events  P03A(t+l)=i,  POSD(t+l)=i,  and 
POSX(t+l)/i  are  conditionally  independent  given  the  positions  of 
A,D,  and  X  at  time  t  one  obtains  (5.7.4.?). 

The  probability  of  termination  along  with  the  mathematical 
expectation  and  variance  of  termination  can  be  determined  from 
5.7.4  as  was  done  in  5*1. 
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5.5.  Strategies  for  the  Fixed  Target  Game* 

Having  derived  expressions  for  the  various  probabilities 
for  the  case  of  where  X  is  fixed,  it  might  be  useful  to  consider 
the  spaces  of  strategies,  and  .  A  partial  ordering  can  be 

induced  on  each  of  Ji  and  . 

5.5.1.  Definition.  For  U-,  and  U0  In  L  define  i  on  Jl  by 

x  <-  "  h  A 

i  if  anx  only  if 


(5. 3.1.1) 

P[A  wins 

•cn 

the 

t-th 

move 

and 

T 

> 

0ltv] 

> 

P[A  wins 

on 

the 

t-th 

move 

and 

T 

> 

t; 

u2,v: 

and 

(5.5*1.?) 

P(D  wins 

on 

the 

t-th 

move 

and 

T 

> 

ui'v] 

< 

PCD  wins 

on 

the 

t-th 

move 

and 

T 

> 

t* 

u?,v: 

for  all  t  <  Tl  and  . 

5.5.P.  Definition.  For  V,  and  in  J  define  <  on  a  by 

x  r  6  i 

V-,  £  V,  if  and  only  if 

C  r 


(5.5.?.D 

PCA  wins 

on 

the 

t-th 

move 

and 

T 

> 

u,^] 

< 

PtA  wins 

on 

the 

t-th 

move 

and 

T 

> 

t; 

U,V„] 

UneL 

[D-  wins 

c 

(5 .5.?.?) 

on 

the 

t-th 

move 

and 

T 

> 

u’vl] 

> 

PCr  wins 

o.n 

the 

t-th 

move 

and 

T 

> 

U,V?] 

for  all  t  <  Tl  and  U  *ja. 
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A  strategy,  U,  in  for  which  there  is  a  stategy  in  dA  fro*  W 

Wiichu£  U  will  be  called  strongly  inadmissible  in  J  .  Similarly, 

A  " 

a  strategy,  V,  in  f or  which  there  is  a  strategy  in  different 

from  V  and  ^  /  will  be  called  a  strongly  indadmissible  strategy 

A 

in  l0  . 

5-3*3  iemma.  (  J  ,  i  )  and  (  J L  ,  £.  )  are  partially  ordered  sets. 

n  *  t/  ** 

Proof:  This  is  a  direct  verification. 

The  effect  of  this  partial  ordering  is  to  eliminate  from 
consideration  those  strategies  for  both  players  which  behave 
"badly"  at  every  time  against  every  strategy  of  the  opponent. 

Several  payoff  kernels  will  now  be  presented  along  with 
some  discussion  of  their  importance.  Define  a  function 

from  l,^,...,T.j  into  C-ltlJ  by 

(5. 5.4.1)  ^(U,V,t)  =  P[A  wins  in  t-th  move  and  T  >  t;U,Vj  - 

P[D  v/inc  in  the  t-th  move  and  T  _>  t;  U,V.i 

for  all  II6 V*jc  and  t. 

Define  K.  a  function  from  j  t  j  to  E^  by 

H  »  ^  M  €/ 


(5. 5. KA  C(IJ,V)«  4  Ka  1  ( U, V,-b) 


A,1 


for  all  rJ  «-/  and  7c  j, 

A  (j 
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Set  Kjj  ^  =  -K^  ^  and  p.  The  game  with  the 

payoff  kerne}.,  p,  for  the  attacker  is  a  two  person  zero-sum 
game.  This  payoff  kernel  seems  intuitively  appealing  when  one 
considers  the  goal  of  the  attacker:  the  attacker  seeks  a  strategy 
that  will  maximize  the  probability  that  he  wins  and  will  minimize 
the  probability  that  he  loses  tc  D.  This  would  be  reflected  in 
A's  efforts  to  maximize,  for  every  choice  of  strategy  in  , 

the  expression  in  (5. 5*4-. 2).  The  defender  will  attempt  to  do 
the  opposite. 

If  the  players  wisn  .  to  consider  strategies  that  will  do 
well  at  each  move,  they  might  use  the  payoff  kernel  , 

Each  strategy  in  either  space  of  strategies 

t 

is  really  a  sequence  and  can  be  represented  as  a  vector,  say 
U  =  (U-p...,^)  «  i*  'and  V  =  (V-^  . . . ,  ^  .  Then  the 

players  are  really  making  sequential  decisions  and  at  the  t-th 
move  A  will  seek  a  strategy  which  maximizes  the  prob cblllty  tfca-t 
he  wi «  s  in  this  move.  Using  the  payoff  kernel  KA  ^ ,  this  is 
reflected  in  A's  efforts  to  maximin  the  expression  in  (5»5*4.1). 

If  termination  at  the  early  stages  of  the  game  is  important, 
then  the  attacker  could  attach  a  weighting  to  the  summands  in 
(5 .5.^.2).  The  general  payoff  kernel,  K.  -  would  be  defined  by 
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(3. 3.4.5)  K.  ,(U,V)  =  ZaX  ,(U,V,t) 

A,?  t*\  ^  A'i 

with  a.  >.  0  for  all  t  >  1  Z a,  <  co  . 

t  **5: 

Inequalities  for  the  above  payoff  kernels  can  be  obtained. 

5.5.5  Lemma.  For  X A  and  XA  -  as  defined  in  (5. 5. 4.1), 

(5.5.4.?)  and  (5. 5.4. 5)  respectively, 

(5. 5. 5.1)  -1  <  KA>1(U,V,t)  <  1 

(5.5.5 .2)  -tl  <  KAj?(U,V)  <  Tl 

(5. 5- 5. 5)  -  la.  <  K.  -.(UtV)  <  2  a, 

for  all  U*^V*i#and  t. 

The  following  theorem  can  then  be  obtained  for  conditions 
on  the  value  of  the  game. 

5-5-6,  Theorem.  If  there  exists  a  real  number  s  and  strategies 
UQ  e  I*  and  VQ  such  that 


XAji(U0,v,t) 

>  S 

for  all  V  <  Jc 

and 

<  s 

■for  all  U«-^, 

then  min 

max 

KA1(U,V,t)  =  KA>1(Uo,V0,t) 

max  min 

KA,l(U’V’t). 

Similar  statements  hold  for  K.  ~  and  K.  -. 

A.,<r  A,  y 
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Proof :  The  proof  is  straightforward  and  so  is  mitted.  A  proof 
also  appears  in  Karlin  [10]. 

Let  us  now  consider  the  payoff  kernels  considered  in  other 
sources.  Charnes  and  Schroeder  in  [53  considered  a  payoff  function 
for  a  pursuit-evasion  game  that  depended  not  only  of  the  strategies 
of  each  player  and  the  time  t,  but  also  on  the  position  of  the 
players  at  time  t.  This  approach  also  appears  in  other  sources. 

It  would  seem  that,  in  the  game  considered  in  this  paper,  the 
players  should  seek  strategies  that  maximize  their  probability 
of  victory  and  minimize  their  probability  of  defeat  (perhaps, 
at  each  stage).  Where  the  players  win  or  lose  should  be  irrelevant. 
If  position  was  important,  this  could  be  built  into  the  strategies 
and  transition  probabilities  at  the  outset  of  the  game. 

A  few  remarks  might  now  be  made  concerning  the  version  of 
the  discrete  game  with  mobile  target  for  the  attacker.  The 
basic  payoff  kernels  would  seem  at  first  glance  to  generali'-  ' 
to  this  situation.  However,  before  any  such  step  ca^  be  made, 
explicit  statements  concerning  the  amouht  and  nature  of  inter¬ 
action  between  D  and  X  need  to  be  made.  With  certain  assumptions 
the  generalization  should  be  possible. 


4.  Examples  of  Strategies  in  the  Discrete  Game. 

Several  examples  will  be  considered  in  this  section.  The 
first  will  be  the  case  where  A  acts  ballistically  and  so  in  a 
completely  nonrandom  manner.  Another  example  is  the  case  of 
completely  randomized  strategies  by  one  or  both  players.  The 
thrid  example  that  will  be  examined  is  the  case  where  one  or 
both  of  the  players  randomize  over  all  lattice  points  in  the 
sector  formed  by  a  certain  arc  determined  by  the  position  of 
the  players. 

Suppose  that  the  attacker  A  acts  in  a  completely  nonrandom 
manner.  If  A  is  not  employing  any  evasive  tactics,  then  D  will 
attempt  to  predict  the  future  position  of  A  and  will  then  attempt 
to  intercept  A.  This  game  would  involve  some  interesting  problems 
in  information  theory.  If,  as  seems  more  likely,  A  employs  some 
type  of  nonrandomized  evasive  maneuvers,  then  A's  strategy  is  fixed 
and  D  will  attempt  to  select  a  strategy  maximizing  the  probability 
of  capture  before  A  annihilates  X. 

A  second  example  of  possible  strategies  is  the  case  of  where 
either  or  both  players  act  in  a  completely  randomized  fashion. 

The  most  elementary  example  of  this  type  occurs  when  each  player 
simply  counts  the  number  of  lattice  points  to  which  he  can  move 
and  assigns  equal  probability  tc  each  -attice  point.  The  game 
then  reduces  to  one  where  two  blindfolded  football  players  are 
hopping  about  a  large  checker  board  with  (A)  trying  to  reach  the 
goal  line  (X)  and  the  other  player  (D)  trying  to  tackle  A  before 
A  reaches  X.  This  case  where  both  players  a<.  t  completely  independ¬ 
ently  of  each  other  is  amusing  but  not  very  useful. 
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A  slightly  less  trivial  strategy  is  obtained  by  having  the 
players  randomize  as  long  as  they  are  far  enough  apart,  but  by 
requiring  that  they  act  using  the  knowledge  of  the  position  of 
each  other  when  "close  enough"  together.  Proximity  can  be 
measured  by  the  usual  Euclidian  metric  superimposed  on  the 
lattice  structure. 

The  third  example  is  one  in  which  either  or  both  players 
employ(s)  "arc  randomization"  strategies.  Suppose  one  is  given 
the  following  diagram  describing  the  position  of  the  players 
at  time  t. 


The  defender  is  at  i'  and  the  attacker  is  at  j.  The  position 
of  X  is  assumed  to  be  fixed  at  0.  D  will  draw  the  line  connecting 

i  to  j.  His  strategy,  determined  before  the  game,  will  prescribe 

a 

an  arc  of  say  9  ,  which  he  will  use  to  consti-uct  the  two  lines 
about  i»j  given  in  the  diagram  above.  D  will  then  randomize 
according  as  his  strategy  dictates,  over  the  points  accessible 
from  his  position  and  within  the  arc. 
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The  attacker  will  be  given  two  angles,  a  and  3, 
"arc  randomization"  strategy.  A  will  draw  the  lines 
j  to  0  and  joining  j  to  i  and  will  construct  sectors 
by  the  angles  a  and  3  about  the  lines  jjO  and  j,i 
as  in  the  following  diagram. 

}  J 


V 


/;\s 


by  his 
joining 
determined 
respectively, 


/ 

/ 

iHk  tO) 

A  will  randomize  with  his  strategy  over  all  accessible  points  that 
lie  in  the  sector  determined  by  3  and  not  in  the  sector  determined 
by  a.  If,  as  is  the  case  when  D  lies  between  X  and  A  and  3  and 
a,  there  are  no  points  in  this  set,  A’s  strategy  might  be  to  perform 
some  evasive  maneuver  directed  away  from  D. 

The  "arc  randomization"  seems  to  be  a  reasonable  strategy 
in  the  sense  that  it  takes  into  account  the  positions  of  the 
players  and  a  the  target.  To  take  into  account  the  distance 
between  the  players  and  the  target  the  strategy  could  make  the 
angle(s)  depend  on  the  distances  involved. 


5.  Extensions  to  the  Continuous  Game. 

Many  of  the  results  in  section  5,  as  well  as  the  examples 
in  section  4,  can  be  carried  over  into  the  continuous  game. 
However,  instead  of  considering  the  probabilities  that  two  or 
more  players  occupy  the  same  lattice  point,  one  would  have  to 
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consider  the  probabilities  that  two  or  more  players  lie  in 
certain  regions.  This  would  involve  replacing  multiple  summation 
over  discrete  lattice  points  by  multiple  Riemann-Stielt j  es  integrals 
over  regions  in  £  or  E  . 

If  it  should  happen  that  the  game  is  being  played  on  a  closed, 

P  5 

bounded  region  in  E  or  E  ,  then,  using  a  compactness  argument, 
only  a  finite  number  of  probabilities  would  have  to  be  calculated. 
Restricting  the  game  to  such  a  region  might  be  done  through  the 
introduction  of  reflecting  or  absorbing  barriers. 

As  in  the  discrete  game,  it  should  be  possible  to  consider 
different  partial  orderings  on  the  spaces  of  strategies  and 
different  payoff  kernels.  In  the  discrete  game  the  partial 
orderings  involve  inequalities  among  certain  probabilities  depending 
on  lattice  points.  The  partial  orderings  in  the  continuous 
game  would  involve  inequalities  among  probabilities  of  player 
occupation  of  spheres  in  the  appropriate  space.  The  payoff 
kernels  would  become  multiple  integrals  over  certain  regions. 

The  examples  of  strategies  remain  virtually  intact.  The 
ballistic  missie  case  remains  the  same.  The  example  where  one  or 
both  players  employ  the  "arc  randomization"  also  remains  about 
the  same  in  that  the  distance  is  now  the  usual  Euclidian  distance 
and  the  randomization  can  now  be  dene  by  imposing  a  probability 
distribution  function  on  the  region  bounded  by  the  arc  and  a  fixed 
distance  from  the  position  of  the  player(s). 
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This  paper  deals  with  an  attack-defense  game  in  which  there 
are  targets  for  both  attacker  and  defender.  There  are  two 
versions  of  the  game,  discrete  and  continuous.  After  these  hav- • 
been  discussed,  the  relation  of  past  re  search  to  the  game  is 
described. 

The  discrete  game  is  considered  in  detail  and  is  divided 
into  two  cases,  fixed  target  and  mobile  target  for  the  attacker. 

In  the  first,  the  attacker's  target  is  stationary  and  in  the  seconi, 
the  target  is  mobile.  In  both  cases,  expressions  for  probabilities 
of  victory  by  either  players  and  termination  at  each  move  are 
derived  inductively.  The  strategies  are  then  examined  for  the 
fixed  target  case  along  with  some  payoff  kernels. 

Some  strategies,  such  as  the  instance  where  the  attacker  is 
ballistic,  are  considered  for  the  discrete  game. 

Finally,  the  extension  of  the  results  obtained  earlier  in 
the  paper  to  the  continuous  version  of  the  game  is  discussed. 
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